DOCUMENT RESUME 

ED 388 341 JC 950 525 



AUTHOR 
TITLE 



PUB DATE 
NOTE 



PUB TYPE 



Twomey, Janine L, ; And Others 

SPRE and the NMSU-A Integrated Assessment and 
Strategic Planning (lASP) Process: What WeWe Learned 
and Where We're Going. 
31 Mar 95 

16p.; Paper presented at the New Mexico Higher 
Education Assessment Conference (Albuquerque, NM, 
March 31, 1995). For more information on the SPRE 
Compliance Matrix, see JC 950 526. 

Reports - Descriptive (141) — Speeches /Conference 
Papers (150) 



EDRS PRICE MFOl/PCOl Plus Postage. 

DESCRIPTORS Accountability; ^Xollege Outcomes Assessment; 

"College Planning; Community Colleges; Educational 
Improvement ; Educat ional Obj ect i ves ; Program 
Development; Program Effectiveness; Program 
Implementation; Self Evaluation (Groups); State 
Standards; Strategic Planning; '"'Teacher 
Participation; Two Year Colleges 

IDENTIFIERS -New Mexico State University Alamogordo • 



ABSTRACT 

In September 1994, the New Mexico Commission on 
Higher Education issued standards for the State Postsecondary 
Reporting Entity (SPRE). To comply with these standards. New Mexico 
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college decided that planning and assessment should be closely based 
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involvement. Since its original implementation, the lASP has led to 
revisions of syllabi and course co.^tent, more effective counseling 
services for at risk students, reallocation of campus financial 
resources, and greater attention towards issues related to the 
Americans with Disabilities and Student Right to Know and Campus 
Security Acts. To respond to the new SPRE standards, the lASP 
committee developed the SPRE Compliance Matrix, listing significant 
outcomes and accountability measures associated with external 
entities. The matrix has served as the basis for developing outcomes 
assessment data instruments, research questions, implementation 
schedules, and operating procedures. The lASP process has proven to 
be very effective in driving positive change at NMSU-A. (The SPRE 
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SPRE and the NMSU-A Integrated Assessment and Strategic Planning (lASP) Process: 
What We've Learned and Where We're Going 

Discussion 

The New Mexico Commission on Higher Education issued Final Draft Standards for 
SPRE in September 1994. Since then, NMSU-Alamogordo, a 2300 headcount branch 
community college of New Mexico State University has actively developed SPRE unplementation 
strategies. We feel that the three-year old Integrated Assessment and Strategic Planning (lASP) 
process is the best vehicle to comply with pending SPRE standards. lASP was developed during 
our NCA self-study. We are faced with multiple requuiements of the Student Right-to-Know and 
Campus Security Act, the 1992 amendments to the Higher Education Act, tlie Carl D. Perkins 
Vocational and Applied Technology Education Amendments of 1990 (Public Law 101-392), and 
other external sources. They and our own desire to assess and improve program offerings and 
student learning propel our continued assessment efforts. The operation of lASP is described in 
the 1994 edition of A Collection of Papers on Self-Study and Institutional Improvement (Leas 
& Lillibridge, 1994). This paper reports how we changed lASP and how well it works after three 
years of operation. It will feature the progress we have made using lASP to comply with SPRE 
and other accountability standards. 
How We Assess Student Academic Achievement 

Classroom assessment and classroom research as advocated by K. Patricia Cross and 
Thomas Angelo is a significant element of our assessment efforts. The assessment of student 
performance is done at the faculty level. Faculty members each do at least one assessment project 
every year. Examples of these projects are reported in Student Academic Achievement: Report 
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to the Provost (Leas, 1993). The Office of Institutional Effectiveness supports faculty 
assessment projects with technical assistance. The faculty member is responsible for the 
development of research questions and project design. Technical assistance includes help with 
study design, statistics, computer analysis, and general advice about establishing valid ways to find 
out how our students are performing. This research includes student surveys, alumni surveys, test 
item analysis, and extensive longitudinal retention and persistence studies. An important 
assessment tool is student performance on standardized licensure examinations. We have joined 
LONESTAR and will use their student tracking system to supplement future reporting and 
research. 

Implementation strategy used to foster faculty support 

Accrediting entities and funding agencies have formalized accountability requirements for 
educational institutions. Like other colleges, NMSU-A faced a NCA accreditation site visit in 
March 1993. At that time, we had no institutional assessment plan, no comprehensive long-range 
plan, and we did not have an institutional researcher. Fortunately we had visionary leadership to 
launch a faculty-driven, self-study process which emphasized institutional improvement. By 
focusing on the question of "how we could do better?" instead of only questioning "what were 
we doing wrong?", the evaluation aspect inherent in assessment activities was minimized. Beyond 
the positive emphasis on improvement, a key to the success of the assessment and strategic 
planning process was that every staff and faculty member and many students had a voice in the 
process (Leas & Lillibridge, 1994). 

Early in the self-study we decided our assessment and planning had to be couched 
conceptually in our mission and purposes statement. The criteria stressed and evaluated by NCA 
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provides the umbrella under which our mission and purposes rests. Once this conceptual matrix 
was developed, the concrete measures of our effectiveness took on more meaning. All employees 
had an opportunity to help develop the conceptual framework and to visualize their role in the 
achievement of our.mission. Our approach was inclusive. Tlie result was that many more people 
understand how assessment yields usable information and provides direction for fulfilling our 
mission (Himebrook, Twomey, Beck, Flores, & Elliott, 1992). 

Guided by decisions to 1) focus on improvement, 2) involve every faculty/staff and many 
students, and 3) be conceptually-driven by our mission and purposes statement, we established the 
cornerstone committees to launch the assessment and planning effon. The three major 
committees were: the Self-Study Steering Committee, the Mission and Purposes Review 
Committee, and the Institutional Assessment Committee. Each committee consisted of personnel 
from all areas of campus; however, in the spirit of our informally endorsed shared-governance 
philosophy, over half the membership of each committee was faculty. The chair of two of the 
committees was a faculty member, and the chair of the Steering Committee was the Associate 
Provost for Instruction. While all departments on campus had a role in the formulation of the 
assessment and planning model, the process was faculty-driven. Therefore, the faculty felt they 
owned the assessment process. As a result, compliance with lASP implementation projects was 
enthusiastic and the results were impressive. 
lASP Changed the Tnsstitn finn and We Changed lASP 

The effectiveness of LASP in terms of concrete institutional change has been considerable. 
The campus has gone from a pre- 1990 attitude of "what's assessment?" and "who i^ally needs it?" 
to the present realization that we may be doing too much assessment. When the Institutional 
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Assessment Committee did its original review of assessment activity in 1990, they discovered that 
quite a lot of assessment was being done on campus, Usually, we did not call what we were 
doing - assessment but it really was! 

Most faculty have fully embraced assessment as a legitimate extension of good teaching. 
Academic assessment varies with each discipline and instructor. While not all assessment 
activities would be considered as high-level classroom research, many have yielded concrete 
results and have led to real and positive changes. In the three years since the advent of LASP, our 
campus has changed. One significant change was the modification of lASP from a one-year cycle 
to a two-year cycle. This was done to allow more time for assessment and planning and more 
time for implementation of the resultant strategic plan. 

Research that focused on developmental studies disciplines resulted in the adoption of a 
new pre-coUege level English curriculum. lASP also showed that learning centers for English and 
Math needed additional space and staffing. We established a Spanish language laboratory to serve 
this expanding program. Other assessment projects led to revisions of syllabi and course content. 
Retention studies have reinforced the notion that not all student groups experience college in the 
same way. This heightened awareness has allowed student service counselors to work more 
effectively with at-risk students. The operational timeline of lASP coincides with the budget 
approval cycle. As a result, lASP promotes the reallocation of campus financial resources. This 
has included the creation of an Office of Information, Office of Institutional Effectiveness, Office 
of Community Education/Distance Learning, and Office of Grants Coordination. lASP clearly 
showed that classroom space allocations were not always consistent with instructional needs. It 
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also allows current issues like the American's with Disabilities Act, Student Right-to-Know and 
Campus Security Act, and state funding formula deficiencies to receive greater attention. 
Reaction of the faculty and staff to lASP 

During the initial phases of lASP, faculty and staff designed and conducted assessments 
examining such aspects of instruction as student academic achievement, instructor effectiveness, 
and course content. All programs, all disciplines, and virtually all classes were individually 
assessed. 

The faculty's assessment role has evolved during the past three years. In the early stages 
of lASP each faculty member assessed each of his or her classes every semester. After a year of 
assessing all classes, faculty were feeling overwhelmed with the amount of time required to do it 
well. Some suggested that classroom teaching and preparation was suffering. In Fall 1994 
faculty, division heads, and administration decided that too much assessment was taking place. It 
was concluded that assessment of programs, disciplines, and classes will be done on a rotation 
basis. The result is that high priority programs will receive the prompt attention they require. 

The decision to slow the pace of the ongoing assessment activity required considerable 
deliberation. Too much assessment might lead to burnout and drive some faculty to settle for 
"face-compliance" in lieu of "real assessment". We resolved it was possible that by doing less 
assessment we just might achieve higher quality assessment. The decision could only be made 
because we had established solid baseline measures during the first lASP cycle. 

Beginning in 1995, we adopted a new faculty evaluation document that includes an 
assessment component. With the guidance of their division head and the support of the 
institutional researcher, faculty will design one expanded and innovative assessment project each 
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calendar year. The linkage of the assessment of student acadenriic achievement and faculty 
evaluation shows the importance NMSU-A places on assessment. We affirm that assessment of 
teaching and student learning is crucial. However, it should not diminish the emphasis on 
classroom teaching and preparation. 
lASP will be used to compl y with SPRE, NCA, etc. 

lASP is a very flexible process. It is continually being upgraded and improved. 
When the 1992 amendments to the Higher Education Act became law, and resultant New Mexico 
SPRE standards were drafted, it became obvious that NMSU-A was going to face substantial 
accountability requirements. These requirements added to those previously delineated by NCA 
accreditation guidelines, the Student Right-to-Know and Campus Securitj' Act, and Carl D. 
Perkins Vocational and Applied Technology Education Amendments of 1990 (Public Law 101- 
392). We realized that we had to do something to manage these often daunting requirements for 
information and reports. Our goal is to create a structured student outcomes assessment program 
to comply with "all" external requirements. The lASP committee established an Outcomes 
Assessment key factor committee to direct this task. 

The Office of Institutional Effectiveness hired an Outcomes Assessment Coordinator to 
update the assessment matrixes that were the basis of the Development of an Assessment 
Package for NMSU-Alamogordo, New Mexico, (1992). Thir> report was the culmination of 
work done for the NCA self-study. Another important tool was an AACC Special Report, 
Community Colleges: Core Indicators of Effectiveness (1994). The goal was to inventory 
campus assessment efforts and needs. This effort was based on a review of pertinent literature 
and extended interviews with program and division heads. The result of this work was SPRE 



Twomey» Lillibridge. Hawkins. & Reidlinger PAGE 7 

Compliance Matrix (Hawkins, 1995). The matrix is based on our mission and purposes 
statement and lists significant outcomes and accountability measures associated with external 
entities. Our approach was to find out: 

1) what we could do [the dream], 

2) what we should do [accountability and reporting requirements], 

3) what we really want to do [whether to ignore the requirement or comply for 
relevant and meaningful purposes], and 

4) what we can do [the reality - money and time issues]. 

This matrix has served as the basis for development for outcomes assessment data collection 
instruments, research questions, implementation schedule, and operating procedures. Our work 
will focus initially on our professional, technical, and vocational programs. The goal is to develop 
a model/prototype to assess other academic programs. 

Summary 

The development, implementation, and operation of the lASP process to assess student 
academic achievement and institutional effectiveness required several years of extensive 
involvement of administrators, faculty, and staff. 

The process has proven to be very effective in driving positive change at NMSU-A. 
Although the implementation of the lASP process has progressed better than anticipated, the 
institution has not become complacent lASP serves as the vehicle to plan and carry out our 
efforts to comply with New Mexico State Postsecondary Reporting Entity (SPRE), NCA, and 
other external requirements. 
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